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TECHNICAL FIELD 

This invention relates to graphical user interfaces (GUIs), and more 
particularly to methods and arrangements for selectively placing movable objects 
within the GUI based on user inputs. 

BACKGROUND 

Graphical user interfaces (GUIs) are popular in a variety of computing 
applications and/or operating systems. A typical GUI provides visual feedback to 
the user of his or her actions (e.g., inputs, and responses thereto). There is a move 
underway to make more devices or other types of appliances seemingly "smarter" 
or more user friendly by introducing similar graphical interfaces and like 
capabilities. Thus, for example, a kiosk, automatic teller machines, microwave 
ovens, video cassette recorders (VCRs), cellular telephones, and the like are 
beginning to provide GUIs that are programmed to enrich the user's interactions 
with the device. This may include, for example, adding selectable icons, 
scrollable lists, and hierarchical pages. 

More interestingly for this Background section, in certain instances, 
physical user interfaces, such as, e.g., knobs, buttons, switches, handles, and the 
like, can be graphically modeled and included within the graphical user interface 
as selectable/movable objects. Hence, a user can graphically open a closed 
drawer, turn up/down a volume control, or perhaps select a feature, product or 
service. 

Causing such an action to occur typically requires the user to provide the 
requisite user inputs to the controlling GUI logic. This may include physically 
moving and/or activating an input device, such as, e.g., a mouse, a trackball or the 
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like, which provides corresponding user input signals to the controlling GUI logic, 
directly or indirectly. 

Another type of physical input device is a touch pad or touch screen. Touch 
screen are usually configured to allow the user to touch an exposed surface of a 
cathode ray tube (CRT), liquid crystal display (LCD), plasma display, or the like, 
through which the GUI environment and GUI objects are visible. Here, the user 
may touch the exposed surface with his or her finger or some other object, such as, 
e.g., a stylus. The touch screen includes a detection mechanism (e.g., an 
electrically detectable grid array) is configured to detect the point of contact on the 
exposed surface and to provide this positional information to the controlling GUI 
logic. Provided with this positional information, the GUI logic can determine 
which portion of the GUI interface and/or GUI object, the user is attempting to 
select, move, alter, or otherwise influence. 

Touch screens are particularly useful and popular in appliances that have 
limited user input devices and/or display capabilities. For example, touch screens 
are popular in personal digital assistant (PDA) devices, cellular telephones, kiosks, 
etc. Unfortunately, when a GUI object is selected in a conventional touch screen 
GUI environment, the position of the pointing device, e.g., stylus, fingertip, etc. 
may not always be at or near the center or other preferred "grab point" of the 
selected object. For example, a user may select a slider portion of a modeled 
sliding control knob at a corner or along an edge. In the physical world, as 
opposed to the virtual world of the GUI, one would not typically miss a slider or 
other knob in this manner when attempting to move/activate it. Granted, sliders 
and certain other types of switches can be pushed from an edge, but this would 
only allow for movement in a particular direction. 



Lee & Hayes. PLLC 



2 



0814001245 MS1-S77US.PAT.APP.DOC 



1 

2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 




Nevertheless, many conventional GUI environments model this unnatural 
capability, while others try to automatically correct the situation. Thus, for 
example, in some cases, an offset between the user input position and the GUI 
object is determined and then maintained throughout the movement/activation 
process. In other cases, the GUI object (e.g., the slider knob) is immediately 
relocated within the GUI environment in such a manner that it is "correctly" 
positioned in accord with the user's input. 

While each of these implementations tends to work just fine, many users 
may find the maintained offset or the immediate correction less pleasing. Thus, 
there is a need for improved methods and arrangements that can provide for a 
more pleasing and in some cases a more realistic user interface capability. 

SUMMARY 

Improved methods and arrangements are provided for selectively placing 
movable objects within a graphical user interface (GUI) or the like, based on user 
inputs. In accordance with certain aspects of the present invention, the methods 
and arrangements tend to provide for a visually more pleasing and in some cases a 
more realistic user interface capability. 

Thus, for example, in accordance with certain aspects, methods and 
arrangements are provided that allow for a gradual visual correction between a 
user's input and a selected object. If an offset exists between a user's input and an 
object's preferred contact area or point, then, as the user manipulates the object 
(e.g., moves the object within the GUI) the magnitude of the offset is selectively 
and incrementally altered over time/distance in a manner that is nearly 
imperceptible to the user. This corrective process is continued, until the user's 
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input and the object's preferred contact area or point falls within some definable 
tolerance. Consequently, the correction process tends to be more pleasing and in 
some instances more realistic than an immediate correction or maintenance of a 
continued offset. 



BRIEF DESCRIPTION OF THE DRAWINGS 

A more complete understanding of the various methods and arrangements 
of the present invention may be had by reference to the following detailed 
description when taken in conjunction with the accompanying drawings wherein: 

Fig. 1 is block diagram depicting an exemplary device having a user input 
mechanism, a display device and graphical user interface (GUI) logic, suitable for 
use with certain implementations of the present invention. 

Fig. 2 is a block diagram depicting an exemplary computer environment 
that is suitable for use with certain implementations of the present invention. 

Fig. 3 is a graphical illustration of an exemplary GUI object in the form of a 
slider control switch having a selectably moveable thumb portion. 

Figs 4(a-c) graphically depict the moveable thumb portion of Fig. 3 at 
different times while being moved and graphically modeled in response to 
continuing user inputs. 

Fig. 5 is a flow chart depicting a process for selectively placing a GUI 
object within a GUI environment based on user inputs. 
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DETAILED DESCRIPTION 

In Fig. 1 a device 100 is depicted as having at least one user input 
mechanism 102, graphical user interface (GUI) logic 104 and a display device 
106. 

Device 100 can be any device, including, for example, a stand alone device, 
a peripheral device, an appliance, a hand-held device, an entertainment device, a 
communication device, a portable device, etc., that is designed to present the user 
with a GUI environment having selectable GUI objects, features or functions. 

With this in mind, in accordance with certain demonstrative 
implementations of the present invention, device 100 can be included within a 
computer, for example, as described below and shown in Fig. 2, and within an auto 
PC environment of a vehicle. 

Input mechanism 102 preferably includes a conventional touch pad or touch 
screen and associated circuitry and/or logic. Input mechanism 102 is configured 
to detect a touch location of a touching mechanism. Here, for example, the 
touching mechanism can be a fingertip, a pin, a stylus, or other appropriate object. 
The location or positional information that is derived from the physical contact is 
typically based on a coordinate system associated with the touchable area on the 
surface of the touch screen. The positional information may be directly associated 
with, or otherwise convertible to match, a coordinate system used by GUI logic 
104. The resulting positional information is provided by input mechanism 102 to 
GUI logic 104. 

GUI logic 104 can include hardware, firmware, software, or any mixture 
thereof. GUI logic 104 is configured to receive user inputs, for example, the 
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positioning information from input mechanism 102, and output signals that cause 
display device 106 to visually display a GUI environment 108 having at least one 
GUI object 110 selectable therein. GUI logic 104 may therefore include many of 
the hardware and software portions as described below with respect to the 
computer shown in Fig. 2. 

Though depicted as functionally separate in Fig. 1, display device 106 is 
preferably operatively and physically associated with input mechanism 102. Thus, 
for example, in the case of a touch screen based input mechanism, display device 
106 would be provided below a non-opaque portion of the touch screen so as to 
allow GUI environment 108 and GUI object 1 10 to be seen there through. 

Reference is now made to Fig. 2, which is a block diagram of an exemplary 
computing system 200. 

Computing system 200 is, in this example, a personal computer (PC), 
however, in other examples computing system may take the form of a special- 
purpose device, an appliance, a handheld computing device, a cellular telephone 
device, a pager device, etc. Moreover, the arrangement in Fig. 1 can be 
distributed between a plurality of computers/devices. 

As shown, computing system 200 includes a processing unit 221, a system 
memory 222, and a system bus 223. System bus 223 links together various system 
components including system memory 222 and the processing unit 221. System 
bus 223 may be any of several types of bus structures including a memory bus or 
memory controller, a peripheral bus, and a local bus using any of a variety of bus 
architectures. System memory 222 typically includes read only memory (ROM) 
224 and random access memory (RAM) 225. A basic input/output system 226 
(BIOS), containing the basic routine that helps to transfer information between 
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elements within computing system 200, such as during start-up, is stored in ROM 
224. Computing system 200 further includes a hard disk drive 227 for reading 
from and writing to a hard disk, not shown, a magnetic disk drive 228 for reading 
from or writing to a removable magnetic disk 229, and an optical disk drive 30 for 
reading from or writing to a removable optical disk 231 such as a CD ROM or 
other optical media. Hard disk drive 227, magnetic disk drive 228, and optical 
disk drive 230 are connected to system bus 223 by a hard disk drive interface 232, 
a magnetic disk drive interface 233, and an optical drive interface 234, 
respectively. These drives and their associated computer-readable media provide 
nonvolatile storage of computer readable instructions, data structures, computer 
programs and other data for computing system 200. 

A number of computer programs may be stored on the hard disk, magnetic 
disk 229, optical disk 231, ROM 224 or RAM 225, including an operating system 
235, one or more application programs 236, other programs 237, and program data 
238. 

A user may enter commands and information into computing system 200 
through various input devices such as a keyboard 240 and pointing device 242 
(such as a mouse). Of particular significance to the present invention, a touch 
screen based input mechanism 255 can also be included as an input device to 
computing system 200. Positioning information is input into computing system 
200 via an appropriate touch screen interface 257. In this example, touch screen 
interface 257 is connected to the system bus 223, thereby allowing the positioning 
information to be stored in RAM 225, one of the other data storage devices, or 
directly to processing unit 221 . 



Lee & Hayes, PLLC 



7 



0814001245 MS1-577US.PAT.APP.DOC 



1 

2 
3 
4 
' 5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 




As shown, a monitor 247 or other type of display device is also connected 
to the system bus 223 via an interface, such as a video adapter 248. In addition to 
the monitor, computing system 200 may also include other peripheral output 
devices (not shown), such as speakers, printers, etc. 

Computing system 200 may operate in a networked environment using 
logical connections to one or more remote computers, such as a remote computer 
249. Remote computer 249 may be another personal computer, a server, a router, 
a network PC, a peer device or other common network node, and typically 
includes many or all of the elements described above relative to computing system 
200, although only a memory storage device 250 has been illustrated in Fig. 2. 

The logical connections depicted in Fig. 2 include a local area network 
(LAN) 251 and a wide area network (WAN) 252. Such networking environments 
are commonplace in offices, enterprise-wide computer networks, Intranets and the 
Internet. 

When^used in a LAN networking environment, computing system 200 is 
connected to the local network 251 through a network interface or adapter 253. 
When used in a WAN networking environment, computing system 200 typically 
includes a modem 254 or other means for establishing communications over the 
wide area network 252, such as the Internet. Modem 254, which may be internal 
or external, is connected to system bus 223 via the serial port interface 246. 

In a networked environment, computer programs depicted relative to the 
computing system 200, or portions thereof, may be stored in the remote memory 
storage device. It will be appreciated that the network connections shown are 
exemplary and other means of establishing a communications link between the 
computers may be used. 
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Reference will now be made to Fig. 3 where an exemplary GUI object 110' 
is shown. In this example, GUI object 110' is a slider control switch that can be 
used to moderate a parameter, select a function, etc. GUI object 110' includes a 
thumb 260 that is graphically modeled as sliding along a channel 262 in a linear 
direction or path 264. 

In this example, GUI environment 108 is based on an x, y coordinate 
system as shown by directional arrows 268. Here, path 264 allows thumb 260 to 
slide parallel to the x-axis and perpendicular to the y-axis. Those skilled in the art 
will recognize that other movements, linear and nonlinear are also possible, 
depending upon the type of GUI object 110. 

Associated with thumb 260 is a preferred contact area 266. Preferred 
contact area 266, which may be as small as a single point (e.g., a pixel on a touch 
screen display), represents a visually appealing area on thumb 260 that the GUI 
designers would prefer users to "grab" each time they selected thumb 260. 
However, as stated above, this is not always possible; sometimes the user grabs 
thumb 260 at a corner or an edge. Moreover, if the GUI software is programmed 
accordingly, the user may actually completely miss thumb 260 but still be close 
enough to fall within a controlling area about all or part of thumb 260. 

In many implementations it would be undesirable to automatically change 
the position of thumb 260 so that the preferred contact area 266 matches the 
positioning information. Not only does this not match the physical world that is 
often being modeled, but it may also cause a controlled parameter, feature or 
function to be altered in someway that was not intended by the user. 
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Conversely, simply maintaining an initial offset that exists between the 
positioning information and thumb 260 during subsequent thumb movements may 
be distractive and is certainly not faithful to a modeled physical world. 

To address these problems and to provide a more visually appealing GUI 
experience, methods and arrangements are provided below that allow for a gradual 
visual and operative correction between the positioning information and GUI 
object 110. 

For example, if an offset exists between a user's input and an object's 
preferred contact area 266, then, as the user moves GUI object 110 within GUI 
environment 108 the magnitude of the offset is selectively and incrementally 
altered over time/distance in a manner that is nearly imperceptible to the user. 
This corrective process is continued, until the latest positioning information 
significantly matches preferred contact area 266 or falls within a defined tolerance 
thereof, or the user stops providing new positioning information. Consequently, 
the correction process tends to be more pleasing and in some instances more 
realistic than an immediate correction or maintenance of a continued offset. 

With this in mind, reference can now be made to Figs 4(a-c), which depict 
thumb 260, as in Fig. 3, at various times while the user is moving thumb 260 
towards the right hand side of the page (i.e., an increasing x direction). The 
corresponding positioning information 270 associated with the touch point is also 
depicted in Figs 4(a-c). For simplicity, in these examples, it is assumed that the 
touch point is only offset from preferred contact area 266 in the x direction. 

As shown in Fig. 4(a), at time t 0 , preferred contact area 266 is situated at 
(*o, yo) and positioning information 270 places the touch point at (x t0 , y 0 ). The 



Lee & Hayes, PLLC 



10 



08 1 4001 245 MSI -577 US. PA T.APP. DOC 



1 

2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 




initial offset in the x direction is therefore equal to the difference between x 0 and 
x t0 . There is no offset in the y direction in this example. 

Thus, it would be preferable to correct the misplacement defined by the 
offset in the x direction. In Fig. 4(b), at time t ls preferred contact area 266 is now 
situated at (x h y 0 ) while positioning information 270 places the touch point at (x tl , 
y 0 ). The resulting offset in the x direction is therefore equal to the difference 
between x\ and x tl . Again, there is no offset in the y direction in this example. 

The resulting offset has been reduced by slowly allowing the positioning 
information to essentially catch up with preferred contact area 266. This is 
accomplished in certain exemplary implementations using a corrective factor that 
effectively causes the movement of thumb 260 in the increasing x-direction to be 
slower than that of positioning information 270. The corrective factor is therefore 
associated with user's movement of thumb 260. 

By way of example, in accordance with certain implementations of the 
present invention, the corrective factor causes the offset to be reduced by 1 pixel 
for every four pixels of movement in positioning data 270. Thus, for every five 
pixels of movement of positioning data 270 in the positive x direction, thumb 260 
will be moved 4 pixels in the same direction until such time as the offset is zero, 
falls below a defined threshold, or the user stops inputting data. If the user were to 
reverse the direction of the movement while an offset still existed, then the offset 
would be maintained at its latest value. 

Fig. 4(c), at time t 2 , shows that preferred contact area 266 is situated at (x 2 , 
y 0 ) as is positioning information 270. Thus, there is no longer an offset in the x 
direction since x 2 equals x t2 . 
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Though the corrective factor that is illustrated above is linear, there may be 
implementations that can benefit from similarly configured nonlinear corrective 
functions. 

A process 300 for selectively placing a GUI object 110 within a GUI 
environment 108 based on user inputs is depicted in the flow-chart of Fig. 5. In 
step 302, at least one GUI object 110 is displayed within GUI-environment 108. 
Next, in step 304, user inputs associated with GUI object 110 are received. In step 
306, a positional offset, in one or more directions, is determined based on the user 
inputs and a preferred contact area associated with GUI object 110. In step 308, 
the positional offset is selectively and dynamically reduced over a distance based 
on subsequent user inputs. 

It is recognized and intended that the above exemplary methods and 
arrangements can be applied to both the x-axis and the y-axis independently as 
well as simultaneously. 

Although some preferred implementations of various methods and 
arrangements have been illustrated in the accompanying Drawings and described 
in the foregoing Description, it will be understood that the invention is not limited 
to the exemplary implementations disclosed, but is capable of numerous 
rearrangements, modifications and substitutions, as set forth and defined by the 
following claims. 
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